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We provide the probability distribution function of matrix elements 
each of which is the inner product of two vectors. The vectors we are con- 
sidering here are independently distributed but not necessarily Gaussian 
variables. When the number of components M of each vector is greater than 
the number of vectors N, one has a N x N symmetric matrix. When M > N 
and the components of each vector are independent Gaussian variables, the 
distribution function of the N(N + l)/2 matrix elements was obtained by 
Wishart in 1928. When N > M, what we called the "Anti-Wishart" case, 
the matrix elements are no longer completely independent because the true 
degrees of freedom becomes smaller than the number of matrix elements. 
Due to this singular nature, analytical derivation of the probability distribu- 
tion function is much more involved than the corresponding Wishart case. 
For a class of general random vectors, we obtain the analytical distribution 
function in a closed form, which is a product of various factors and delta 
function constraints, composed of various determinants. The distribution 
function of the matrix element for the M > N case with the same class 
of random vectors is also obtained as a by-product. Our result is closely 
related to and should be valuable for the study of random magnet problem 
and information redundancy problem. 
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I. INTRODUCTION 



Many problems in physics [|T| can be related to the matrix problem that we will discuss. 
The matrix we shall consider in this work takes a special form: each matrix element, Y^j 
is the inner product of two independent random vectors. Historically speaking, this type 
of random matrix came into research literature even before the now-called random matrix 
theory first introduced and explored by Wigner, Dyson, Mehta and others |1. The number 
of degrees of freedom is important for this class of matrices. Denote N the dimension 
of square matrix Y, M the dimension of the vectors. Depending which is larger, the 
resultant matrices can be singular with lots of zero eigenvalues; or normally behaved. 

The original motivation to study this type of distribution function mainly come from 
the effort to understand the correlations of fluctuations. But in recent years, interests 
have manifested in studying the case where matrix elements are not independent, but 
inner products of vector-pairs. To be more precise, let us consider the following precise 
definition. Mathematically, we may denote N vectors x±, X2, • • • , xn, each of which lives in 
M dimensions. For example, vector Xi has its components xj,xf, ■ ■ ■ , xf 1 . After shifting 
by the average in each sample, and possible rescaling, we may assume that the vector 
components xf (for all i G {1, 2, • • ■ , iV}, a G {1, 2, ■ ■ • , M}) are random variables with 
some distribution function P({x"}). We then define the Matrix of interest Y whose 
matrix element Yy is simply defined 

M 



Yij — Xi ■ Xj — x i x j ■ ( 1 ) 

a=l 

When M > N and the background distribution P({xf}) being a Gaussian 



det^Vin , 1 N 



eX P(~9 &i'Zj<7ij), (2) 



Wishart obtained B in 1928 a compact expression for the distribution function of 
P({Yij}). The result looks simplest when the matrix [a] is an identity matrix, and we 
have 
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PdYij}) = AT 1 det[Y]( M - iV - 1 )/ 2 exp(-Tr Y/2) (3) 

where M is some normalization constant. For the case of general [a], we replace the 
exp(— Tr Y/2) part by exp(— X^=i A general re-derivation can be found in Q. 

This result has been the fundamentals (and one of the triumphs) of multivariate statistical 
inference. When the components of the vectors are not Gaussian variables, this is still a 
challenging problem not to mention the generic case in the opposite direction M < N, 
which we coined as "Anti- Wishart" case. 

In this paper, we will extend the analytical result to a class of more general P({xf}) 
and also to the "Anti- Wishart" case. Basically, we will consider the case where 

N 

p({xf}) = i[m-x l ). (4) 

i=i 

Note that each vector x,{ is allowed to have a different spherical distribution function. 
For example, we allow f\ being a Gaussian, fi being a delta function C5(x2 ■ X2 — 1) 
constraining the vector Xi to have unit length etc. 

In Wishart's case, the matrix elements Yij of Y have enough degrees of freedom. All 
the eigenvalues are nonzero generically. This is so because the original degrees of freedom, 
MN is larger than the number of Y^s, N 2 . The case for M < N, however, eluded our 
reach for many years. Partly due to the difficulty in dealing with singular measures 
and partly due the lack of motivations. However, recent advances in many branches of 
science have necessitated quantitative knowledge about distribution function of this sort. 
One simple example come from the study of bio- molecular interaction matrix, e.g., the 
protein-protein interaction matrix that is now intensively studied in molecular biology. 
The knowledge of such matrix is extremely important to quantitatively understand how 
cell function, etc. Another example come from the scenario in global knowledge network 
proposed by Maslov and Zhang |j| where information redundancy is exploited. Finally, 
in the random magnetic system the coupling J^- between two spins Sj and Sj could be 
random variables obtained form inner product of two vectors X{ and Xj that characterize 
the property at each specific sites % and j. This actually happens while transforming a 
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two dimensional XY random field magnetic model into a random bond one ||. In this 
case, it will be very desirable to have knowledge of such distribution function. 

In this paper, for the class of random vector distribution (|]), we document down 
for the first time the correct exact distribution of {Y^} in analytical form using only 
fundamental tools of linear algebra. To have the best flow in showing the derivation, we 
will state two useful lemmas and introduce useful notations in the next section followed 
by another section devoted to the derivation. The proofs of the two lemma are relegated 
to the appendix. 



II. TWO LEMMAS 

Before we get to the derivation of the distribution function, we would like to introduce 
some useful notation and state two useful lemmas. First, let us denote A^ ^ ... ^ as the 
determinant of a compactified matrix obtained by eliminating from Y matrix elements 
whose both indices are not completely in the set z 2 , ■ ■ ■ , ix}- For convenience, we define 
A 

i,2,-,l-i = 1 an d — Yjj when L — 1. Naturally the following abbreviations 

Ai )2 ,...,£-i = A and A 1]2) ...,l-ij = A 0j - = Aj when L = 1 apply. 

The notation (i + j) denotes a single index with the following rules: Y^u^ = Yij + Y ik 
and Y(j +k \(j +k \ = Yjj + Y k j + Yj k + Y kk . Having introduced such notations, we now state 
the two useful lemmas. 

Lemma 1 Provided the matrix Y is symmetric, using the above definitions we have 

4 A 1]2j ...,L-l,fc ' Ax t 2,-,L-lj ~ 

, 2 



(^l,2,-,L-l,<fe+i) ~ Al,2,-,L-1,A: — Ai )2) . 



= 4 Ai iVv l_i • A 1)2 ,...,i-i,* I j (5) 
Lemma 2 Using the above definition and assume the matrix Y being symmetric, we have 

Al } 2,.:,L-l,j ■ A.i ) 2 ) ... ) i_i ) (fc+{) — Al,2,-,L-l,k ~ Ai j2) ... ! i_i ! 
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Al,2,-,L-l,(j'+fc) — ^l,2,-,L-l,k ~ ^l,2,-,L-l,j 
Ai, 2 ,...,L-l,(j+/> - ^l,2,-,L-l,fc - Ai j2 ,...,L-l,Z_ 
Ai j2j . ' 
Ai, 2 ,...,L-lJ,(fe+0 - Ai j2 ,...,L-i,j,fc - Ai j2 ,...,L-i,j 



(6) 



III. DERIVATION 

In this section, under the Gaussian background distribution we will derive the Anti- 
Wishart distribution and also obtain the Wishart distribution as a by-product. Formally, 
we write the distribution function as 



P({Yij}) = J dxidx 2 ■ ■ ■ dx N 



N 



II fi 

.1 = 1 



Xi ' X% 



i<3 



Xi 



Xj) 



(7) 



where Xi ■ Xj = J2a=i x i x< j * s the mner product of vector % and vector j. When the 



components of each vector are independent Gaussian random variables, one has 



N 



Um-x i ) = (2n)- MN /*exp 



i=i 



1 



N M 



z j=l a =i 



(8) 



We will come back to it when compare to the Wishart result. 

Because we want to go beyond the case where components of each vector are indepen- 
dent Gaussian random variables, our strategy is to integrate one solid angle at a time, 
see below. Since the matrix elements are invariant under rotation in the M dimensional 
space, we can choose X\ || e M and write the components of the rest of other N — 1 vectors 
in polar angles, i.e., write 



xf = riCOS0M-l;j 



X 



M-l 



X 



M-2 



n sin M _ 1;i cos 9 M -2-,i 

n sin M _ 1; i sin M _ 2 . 4 cos M -3 ; t 
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x\ = r { sin 9m-i; i sin 9 M -2- i • ■ • sin 2; * cos 9 1; i 

x\ = Ti sin 9 M -i; i sin 9 M -%- % • • • sin 2; i sin 6>i ; » (9) 

where the notation # a; j represents the ath polar angle of the zth vector. Under such 
decomposition, the volume element 

M-l 

dXi -> r^dnd^M) = rf- x dr % J] [sin ^c^] (10) 

a=l 

where < #2<a<M-i; 2<i<7V < ^ an d < #i ; 2<i<iv < 27r are the polar angles and are 
bounded by the expression above. Naturally, the solid angle element in 6 dimension 

is given by 

dSU(b) = nfsin^ 1 ^,]. (11) 

0=1 

One can immediately integrate away first the N radial vectors to get rid of the delta 
functions contain only diagonal elements of the matrix. We then integrate away the solid 
angles 9m-i-2<i<n- After the first stage, we have 



P({Ya}) = 2 



-N 



N 



Ufi(Yu) 

i=l 



N 



lvi — A J i \ 

IJKi 2 dfii(M)] J] 5 (r y - V^i%cos0M-i ;i ) 

*=1 j=2 



where 



n 5 - ^%y fefc / i)A (M - 1)) (12) 

2<j<k<N 



Ij,k{a) = cos 9 a .j cos 9 a . k + sm9 a .jSm9 a;k I j!k (a - 1) (13) 



with 



J j fc (a = 0) = 1 for all j, jfe. (14) 

Note that the factor Yl^ =1 fi{Yn) becomes (27r) _M7V//2 e _ 5 TrY when the components of 
each vector are independent Gaussian variables. Note that in eq. (|T2|) the delta functions 
do not depend on the polar angles of vector x\, therefore we can integrate dfli and obtain 
a factor Km, area of unit sphere in M dimension. Now let us note that we may rewrite 



Yij = |[A^ +J -) — Aj — Aj] = |[A 0) (i+j)— A ,i— A j]. We can therefore rewrite the expression 



(0) into 



^({*y}) = 2 



-TV 



/V 



A? 



.i=l 



1, 



K 



M 



N 



i=l 



M-2 
2 

t 



■ at 

n^( M ) 

,i=2 



' II 5 [ o[ A 0,{l+i> - A 0,l - A 0J ] - ^AciAoj COS0 M -1; j 
j=2 VZ 



II 6 ( 9 [ A o,0'+fe> - A ,j - Ao, fc ] 

2<j<k<N VZ 



We may then integrate away 0M-i-,2<j<N using 

1 /-t/Ao.iAo, 



A 0>j A 0>k I jtk (M - 1) 



(15) 



sin 6 jd9j 



(16) 



where ?/ = w A ^Aq j cos9j. Note that because of the delta functions 



Ao,iA j co>0 : .i |. ; = -[A ,(i+j) — A 0) i — A ,j] 



sin 6* 



M-l;j 



1 — COS 2 # 



M-l;j 



'AqAq, 



1../ 



A ,iA , 



(17) 



where lemma 1 and < Om-i-j < ft are used in the sine part of the above equation. 
Therefore the integral over polar angles {Om-i-j} f=2 yields 



P({Y*}) = 2 



-N 



- n 


(JV-2)(JV-]\/+l) 


' M _ 3 ~ 






K M A, 2 




/[ 


.i=i 




i= 2 





TV 



Y[dQi(M- 1) 



i=2 



1 



II 6 [n i A Uj+k) - A ly3 - Ai, fc ] - \ A, ; A;./,/,./,(.\/ - 2; 

2<j<k<N VZ 

where lemma 2 and S(x/a) = a S(x) are used. 

A moment of reflection tells us that Ij yk (M— 2) is nothing but setting all the Qm-v, j(k) = 
tt/2 so that the Mth component of vectors Xj and x k are identically zero. Or equivalently, 
we are then looking at vectors living in M — 1 dimensional space instead of M dimensional 
space. Since the solid angle of vector X\ and all the radial components of the vectors are 
completely integrated out, we are now left with N — 1 unit vectors living in M — 1 
dimensions. We can then again require that the M — 1th component of vector X2 to be 



along e-M-i so that x^ 1 1 = 1 and X2 



Ka<M-2 



0. We then again write the components 



of the other unit vectors in polar angles such as in (|) but with 0M-i-,2<i<N = 7r /2 and 
&m-2-,2 — 0. Note that spherical symmetry guarantees that dQi(M — 1) has exactly the 
same form regardless how one chooses the axes. Under such consideration, we note again 
that l2,3<k<N = cos 9m-2; k and the delta functions again give us that 



1 



A 1)2 Ai ifc CO8 0M-2;k = ^[^l,{2+k) ~ A 1>2 - A ljfc ] 



sin 6 



M-2:k 



1 — COS 2 6 



IA 1 A 1 



2.k 



M-2:k 



(19) 



/ A 1)2 A 1)fc ' 

again we have used < 0M-2-,k < ^- After such understanding, we may then proceed 
to integrate the polar angles &M-2;3<i<N an d, noting that the solid angle integration of 
dfl 2 (M — 1) leads to K M _ 1: obtain 



P({Yij}) = 2 



-A 



■ N 

.1=1 



(JV-3)(iV-M+l) 

K M K m _i A 12 2 



M-4 
2 



N 

n A ~,2, 

3=3 



N 



JJdfli(M-2) 



Li=3 



II Mo [ A l,2,(i+fc> - Al,2,j - Ai i2 ,fc] 
3<j<k<N VZ 



A w A lf3)fc I iifc (M - 3)) 



-A' 



/V 



JJdfii(M-L+l) 



(JV-L)(JV-M+1) 

Km K M -i ■ ■ ■ K M _ L+2 A lj2> .„ )£f i 1 



A? 



A 



1 



II ^ ( «IAl,2,-,i,-l,(j+fc) ~~ A. -J.. ./, .j — Ai )2l ...,L-l 
L<j<k<N ^ 



^l,2,-,L-lj^l,2,-,L-l,fc Ij,k{M — L) 



Now we see how this process can continue with application of lemmas 1 and 2. When 
N < M, the process actually terminate at L = N where all the delta functions have been 
integrated out. In this way, we have extended the celebrated result of Wishart to the 
more generic case 



P({Yij}) = 2 



— JV 



N 

UMYu 

Li=l 



N 

n km-i+i 

J Li=l 



2 

2,--,N 



■ N 

n 

i=l 



-i+l 



[det(Y)] (M-iV-l)/2 



(21) 



and in the more restricted case with Ilili/tO'ii) = (2vr) M7V / 2 exp(— ~TrY), we have 
exactly the Wishart result 
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p({y y » = (2tt) 



-MAT/2 



■iV ^ 

n 

i=l 



M-i+1 



[det(Y)]^ M-Ar_1 ^ 2 exp(-^TrY). (22) 



For the case of our interest N > M, however, the integral does not terminate that 
way and there will be leftover delta functions. The furthest we can go then is to integrate 
till L = M together with one last complication that the range of angle 9\-i is between 
and 2ir (instead of between and it) and therefore sin# 1; j can take both positive and 
negative signs. To see it explicitly, we may integrate up to L = M — 1 and notice that 
Ij k(l) = cos Oi; j cos#i ; fc + sin0i ;3 -sin0i ; fc because of /^(O) = 1. This way, we have 



P({Yij}) = 2 



-N 



N 
U=l 



(N-M+1)(N-M+1) 

Km Km-i ■ ■ ■ K 3 A 12j ... )A/ ^ 2 



N 

n ^(2) 

i=M-l 



1 



II <M q [^l,2,-,M-2,{j+fe) ~~ A-l,2,-,Af-2,j — ^l,2,-,iW-2,fc] 

M-l<j<k<N ^ 



-\/ A l,2, 



M-2,j^l,2,-,M-2,fc 



• ii fc ( 1 



(23) 



We then again choose the effectively the direction of the (M — l)th unit vector to be along 
the direction and therefore the solid angle of the new unit vector %-i that lives in 
two dimensions. This way, we have 



-N 



N 
Li=l 



M 
3=1 



(JV-M)(JV-M+1) 
A 2 



A 1 



n ( A i,2,-,Af-i,jO 

i=M 



-1/2 



II ^ ( 9 [^l,2,-,iU"-l,0'+A) — A.l,2,--,M-lj — Ai^,...^-].,*] 
sgns M<j<k<N ^ 



sgns J A lj2 ,...,M-l,j Ai )3> . 



,M-l,fc 



(24) 



where 

r2vr 







dcosO r 2n dcosO 
ii sin 6* Jtt sin# 



sin#| 



y dcosO |sine>o + y dcosO 



sin6»<0 



(25) 



is used. Now the sum over "sgns" deserves some explanations. Each candidate of sin 1; j in 
eq.(|2"3"D in principle can take both positive and negative values. This means that for each 



k, the quantity i/A 1a ...m-i,|; can carry both positive and negative signs. Because each of 



the remaining reduced unit vectors xm, %m+i, • • • > £jv can pl & y a r °l e i n v^i,2,-,M-i 1 )e! we 



therefore have to consider 2 N ~ M+1 different combinations. That is to say, our sum over 
signs actually consists of 2 N ~ M+l terms each of which is a product of (N— M)(N— M+l)/2 
delta functions. In order to better organize these delta functions, we introduce two new 
notations: 



2,-,M-l,fc 



1 

2 1 



B kJ = 7^>\k+l) 



- bl - &?] 



(26) 
(27) 



Under this new notation, we may rewrite our distribution function as 



PdYij}) = 2 



—N 



■ N 

.1=1 



M 
J=2 



(N-M)(N-M+1) 

A 2 

a l,2,-,M-l 



N 



II (Al,2,.,M-lj) 
j=M 



-1/2 



II 5 ( B jk - SjSk bj b k ) 
{s i= ±l} M<j<k<N 



(2f 



where Sj = ±1 are Ising variables conveniently introduced to represent the signs needed. 



Note that although eq.(|2q) could be regarded as the end result of integrations, to render 
it useful we will reassemble these 2 N ~ RI+1 combinations into a single term. This is in 
some way similar to obtain the partition function of an Ising system by summing up all 
possible spin configurations. We may also say that obtaining eq.(|28|) is only half way to 
our goal. 

To work towards the final goal, we now start the task of reassembling these 2 N ~ M+1 
terms of product of delta functions. When applied to symmetric matrices, lemma 1 (with 
L -> M) tells us that 



b\b\ - B* 



Ai, 2 ,., 



M-l 



Al,2,-,i 



(29) 



With the labeling of k e {M, M + 1, • • • , iV}, we can now order the ± signs carried by 
each bk in the following manner. First, we observe that if we change the signs of every 
bk, the delta function is invariant. This immediately leads to a two fold symmetry which 
allows us to require that the sign carried by bw being always positive. Although there are 
in total 2 N ~ AI+1 terms in the sum, the two-fold symmetry dictates only 2 N ~ M different 
terms. These terms are selected by our choosing b^ always carrying positive sign, i.e. 
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sn = 1. For the 2^ M different terms, we generate them in the follows: We first write 
down the two cases where 6m can be either positive or negative. We organize it as 



sm 



+ 



(30) 



We then make two identical such copies. For the first copy we have &m+i carrying positive 
signs, and for the second copy we have &m+i carrying negative signs. 



sm+i sm 



+ 
+ 



(31) 



+ 



We then make two identical copies of the above. We again in the first copy put in &m+2 
that carries positive signs and in the second copy put in &m+2 that carries negative signs. 
We then arrives at 

SM+2 Sm+1 Sm 



+ 
+ 
+ 
+ 



(32) 



+ + 

+ - 

- + 

+ + 

+ - 

- + 



This process keeps going till we adding positive-sign-carrying &at_i to first copy and 
negative-sign-carrying &at_i to the second copy. After that we add positive-sign-carrying 
b]\f to every term. We finally have something look like 
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SN 


SjV-1 • 


■ • Sm+2 


SM+l 


sm 


1 




+ 


+ ■ 


■ + 


+ 


+ 


2 




+ 


+ • 


■ ■ + 


+ 


— 


3 




+ 


+ • 


■ • + 


— 


+ 


4 




+ 


+ • 


■ • + 






5 




+ 


+ • 




+ 


+ 


6 




+ 


+ • 




+ 




7 

8 




+ 
+ 


+ • 
+ • 


— 


— 


+ 
— 


nN-M _ 


3 


+ 


— 


— 


+ 


+ 


nN—M _ 


2 


+ 






+ 




nN-M _ 


1 


+ 








+ 


2-AT-M 




+ 











(33) 



We now start by combining terms 21 — 1 and 21 for all I < 2 N ~ M ~ l . In order to simplify 
the notation, we shall only write out the 2{ Si =±i} T\M<j<k<N $(Bjk — SjSk bj bk) part and 
multiply the final results by appropriate factor later. In table (|33|), the first term has all 
the bk carrying positive signs, i.e. Sk = 1, while the second term has bu carrying negative 
sign but with the rest of bk carrying positive signs. The sum of the first and the second 
term therefore look like 

N 



<5(^m,m+i — b M b M +\) \\ 5(B M ^ k — b M b k ) 

k=M+2 
N 

+ S(B M>M+ i + b M b M +i) J! $( B M,k + b M b k ) 



n 

(M+l)<k<l<N 



b k h) 



(34) 



In the 



k=M+2 

k= M+2 $(BM,k — bu bk) part of the first term, we replace 6m by Bm,m+i/6j/+i and 
bk by B M +i,k/b M +i- For the Y\k=M+2 K B M,k + b M h) part of second term, we replace b M 
by -Bm,m+i/^m+i and bk by BM+i,k/bM+i- This way, the sum of the term 1 and term 2 
can be rewritten as 
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[S(Bm,m+i — bu bM+i) + ${Bm,m+i + bu &m+i)] 



Bm m+iBi\ 
~b\ 



n ^m,.- M ' M ,r + ' ) n ^i-mo 

k=M+2 °M+1 (M+l)<k<l<N 

_ 9 ^M+l r/ A X 

— ^-T O v ^l,2---,M-l,M,M+lJ 

A 1,2,---,M-1 



^ R R 

n ^m,- M - M ,r M+i ' fc ) n mo ( 35 ) 

k=M+2 °M+1 (M+l)<k<l<N 

Similarly, the third and the fourth terms can also be added to 

N 

${.B M>M+ i + bu bu+i) \\ 5{B M ^ k — bu bk) 8(B M+ i^ k — &m+i b k ) 

k=M+2 
N 

+ 8(B m ,m+i — bu bM+i) ]J ^(B M ,k + b M b k ) S(B M+ltk + b M+1 b k ) 

k=M+2 

I] S(B k)l -b k k), (36) 

(M+l)<k<l<N 

and with similar reasoning this sum leads to 



b M b M +l u a x T~T r/ R B M ,M+lB M +l,k ^ 
<H^l,2---,M-l,Af,M+lJ 11 0{-DM,k To ) 



— J .,^,-,,„- J . k=M+2 U M+1 

N 

II 5(S M+lifc + 6 M+ i6 fc ) II KB^-hh). (37) 

fc=M+2 (M+2)<fe</<AT 

One thing we notice immediately is that if we factor out the common factor between the 
sum of term 1 and 2 as well as the sum of term 3 and 4, we see an expression that is very 
similar to the original one as if the variable bj^ does not come into the picture in the first 
place. 

In fact the common factor 

9 b M b M +l r/ A X -A" r (R B M ,M+l B M + l,k x , x 

^■r f)(Ai )2 ...,M-i,M,M+iJ 11 d{B M ,k jo ) (38) 

A 1,2,-,M-1 k=M+2 °M+1 

is the same for every pairwise sum of k — 21 — 1 and k = 21. The reason is very simple. 
Originally we have for M + 2 < k < N 

S {B M ,k - s M Sk b M b k ) (39) 

in the product and we also have delta functions 
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8 (Bm,m+i ~ SmSm+1 i>M &Af+l) 

5 (B M +i,k - s M +iSk b M +i h) (40) 



which give us 



, Bm,m+i , , B M +l,k /A .s 

smOm = 7 ano - s kh = 7— (41) 

SM+l Om+1 Sk Ok 



Upon substitution into eq.(p9[) we have 

5 { Bm * ~ (42) 

and using the fact that (s/c) 2 = 1 for all 1 < k < N. We thus proved that every pairwise 
sum produce such common factor. Furthermore, when we sum up those terms together, 
we reduced the number of terms exactly by half and at the same time gain a factor 2. 

Remember that the sign of b^ is fixed to be positive, i.e. = +1 and this process 
ends when turning 5(Sjv-i,jv — sn-iOn-iOn) + £(-£? at^tv + sat-i^n-i^v) into a single delta 
function, which corresponds to k = N — 1 and I = N. Note that we start with k = M, 
therefore, we have to do the same process for N — M times. Together with the two-fold 
symmetry we mentioned at the very beginning, we will end up with 



2 • 2 



N-M 



N ~ 1 b b- ] 

II A 3 3 <KAl j 2,... ) jW-l,,, / --l I 

j=M 



Ai 2 ... M_i 



N-2 N / R R \ 

n 11 1 k. - B "f' +it ) (43) 

j=M k=j+2 \ u j+l / 



To further simplify the expression, we see from lemma 2 that 

BjjBi )k — b\B^ k = — -(Ai t 2,...,Af-l,Z,0'+fc) ~~ ^-1,2,-,M-1,IJ — ^l,2,-,M-hl,k) ' ^1, 2, -,M-1 (44) 



and with I — > j + 1, we see that 

S(B jlk 



ft 2 

°7+l 



^ f O [^l,2,-,M-lj+l,(j+jfe) — Aj^j.-jAf-lJ+lj — Ai^^.^M-lJ+l.fc] ) (45) 



Ai 5 2,---,M-1 \2 

We can now include the part we did not include explicitly and obtain finally 



14 



- N I M is N-l 




N-l 



.i=l J \j=l J j=M+l 



j=M 



N-2 N 




n n %[a 



l,2,-,M-l,j+l,<j+fc> 



-A 



l,2,-,M-l,i+l,j 



i-A 



i 



,2,-,M-l,j+l,k. 



j=M k=j+2 



The reason that this final expression does not look very symmetric come from the fact 
that when we exploited the gauge degrees of freedom we chose X\ to be parallel to ejvf, £2 
parallel to e-u-i etc. Therefore, any permutation of the vectors in the order of integration 
should give identical results. When one consider that version, the symmetry will appear 
explicitly. The current expression, however, could be more useful from the standpoint 
of numerical use as will be explained in a separate publication [7] where more details 
will be presented. An alternative way to get the equivalent expression is to diagonalize 
the Y matrix first, and then focus on the nonzero eigenvalues of the Y matrix. Being 
seemingly more elegant, this way gives the same results and does not necessarily provide 
an easier way to calculate conditional probabilities for predicting redundant information. 
The application of our results as well as comparison of various approaches will be discussed 
in a later publication 0. Because our method only assumes spherical symmetry in the 
ensemble of vectors, it can be applied to magnetic systems where the spins are of fixed 
lengths. Our method also bears potential to model the real knowledge network where the 
components of a vector might not be completely independent random Gaussian variables. 

Finally, let us end with a brief note. After the calculational part of this work was 
completed, Janik and Nowak H recently presented a similar result which followed closely 
the route in Their method is simple but crucially depends on the random Gaussian 
ensemble assumed. Interestingly, the two results display a crucial discrepency in terms 
of the number of constraints (delta functions). Although the degrees of freedom counting 
is somehow elementary, we would like to go over it again here. We first note that there 
are NM integration variables. However, the gauge symmetry assures that only NM — 
[M(M — l)/2] of those integrations are independent with respect to the Y matrix. Since 
the Y matrix has N(N + l)/2 independent matrix elements, we therefore find that the 
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final number of delta functions should be N(N + l)/2 - {NM - [M(M - l)/2]} = 
(N — M)(N — M + l)/2. This expected number of delta functions indeed show up 
naturally in our final expression. 



ACKNOWLEDGEMENT 

We thank the hospitality of ITP at UCSB where this work was initiated. YKY wishes 
to thank V.P. Nair and R. Friedberg for useful discussions and encouragement. He also 
acknowledge the hospitality of Center for Studies in Physics and Biology of Rockefeller 
University where the calculational part of this work was completed. This work is sup- 
ported in part by NSF DMR-0110903. 

APPENDIX 

Let us first prove lemma 1. 

For illustration purpose, we draw the matrix determinant represented by ^i,2,-,L-i,{k+j) 
as 



det 





Y 12 




^1,L-1 


Y lk + Y Vj ^ 


Y 21 


Y22 




^2,L-1 


Y 2 k + Y 2 j 


















Yl-\,L-1 


Y L - lik + Y L _ ld 


Yki + Yji 


Yk2 + Yj 2 




Y k ,L-l + Yj,L-l 


Ykk + Yjj + Ykj + Yjk j 



(47) 



From above illustration, we have 



^l,2,-,L-l,{k+j) — [Ykk + Yjj + Yjk + Y k j] A li2; . 



L-l 



+ ^(-l) L+n [Y kn + Y jn ]A L , n ((k + j)) 



(48) 



n=l 



where Al iTI ((A; + j)) denotes the minor of the matrix element on row L column n in 
the matrix shown above. Note that the elements on the Lth column are given by 
Y„e{i,2,-,L-i},{k+j) and the elements in the Lth row are given by Y {k+ j) <ne { lt 2,-,L-i}- Simi- 
larly, 
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L-l 



A, ........ ,., = £ Y kn (-l) L+n A L , n (k) 



n=l 



+Y kk Ai j2 ,...,l_i (49) 
and an identical expression exist for Ai t 2,-,L-i,j- One immediate observation is that 



A L , n (( k + 3)) = Kn{k) + AlM- 



(50) 



This part can be easily seen if we calculate each minor by expanding along its last column 
L — 1: summing elements on row L — 1 and column 1 < n < L — 1 multiply by their 
corresponding subminors. Note that 

\ 



A L , n ((k + j)) = det 



Y 2 \ Y 2 2 



Yl,n-1 

^2,71-1 



Y 1 



,n+l 



Yn 



2,n+l 



Y lk + Y l3 
Yik + Y 2 j 



y Yl-1,1 Xl-1,2 ' ' ' Yl-1 : ti-1 Xl-1,71+1 ■ ■ ■ Yl-1^ + Yl-ij ^ 



, (51) 



and 



A L , n (k) = det 



Yn Y12 ■ ■ ■ Yi n _i Y 1 ,n+l ' ' ' Yi k 

Y21 Y 2 2 ■ ■ ■ ^2,ra-l ^2,n+l ' ' ' Y 2 k 



(52) 



-1,71+1 ' " ' Y L -i,k J 

Since the subminors associated with such decomposition are exactly the same whether 
the elements at the last column is (k + j) or just k or I. 
Now let us re-express the quantity of interest 



^■l,2,-,L-l,{k+j) — Ai i2 ,...,L-l,fc — ^l,2,-,L-l,j 

= E(-l) L+n [Y kn (AL,n((k + j)) 

71=1 

-A Ltn (k) + Y jn (A Lin ((k + j)) - A Lyn {j) 

+[Y kj + Y jk ]-A 1 , 2 ,.., L -i 
= J2(-l) L+n \Y kn A L , n (j)+Y jn A L , n (k) 



n=l 



+ [Y kj + Y jk ] ■ A 1i2 ,...,l-i 



(53) 
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And consequently, we have the square of the above expression as 



IAi,2,-,z-i,<fc+i) — Ai )2) ...,i_i,fc — Ax^.-.^-ij] 2 
= [Y jk + Y kj } 2 • A 2 1)2i ... )Z _ 1 + 2 + Y kj ] ■ A 1i2 ,..,l-i EC- 1 )^ **AnO') + ^L,n(fc) 



L-l 



n=l 



L-l 



n=l 



+{E(-!) L+n n^,nO') + ^n^,„(A;) } 



(54) 



Using eq. (^) and a similar one with replaced by j , we now write 

L-l L-l 

= E E Y knA L ,n(k)Y jn >A Lin ,(j) 



n=l n'=l 



L-l 



L-l 



+Y kk ■ ^2,-,l-i E (-l) L+n 'Yjn>A L>n r(j) + Yjj ■ A 1)2r .. )L _ 1 J2{-i) L+n Y kn A L)n (k) 



n'=l 



n=l 



' A 2 2 ... L-l 



(55) 



We are now just one step away from proving lemma 1. We start with a determinant 
identity 



A 



D 



\ ( 



C 



A 



b) y d 



\ ( 



in 



Im J \ 



\ 



A~ X C 



B-DA- l C 



(56) 



and consequently 



det(Y) = det(A) • det(£ - DA~ l C). 



(57) 



This tells us that we can rewrite Ai : 2,-,L-i,k,j m the following form: 



Ai,2,. 



,L-l,k,j 



det 







Y lk 


YiJ 














Y L -i k 


Yl-ij 


Y kl 


Y k2 ■■■ 


Y kk 


Y kj 




Y J2 ■■■ 


Y jk 


Yjj 



\ 



Ai, 2 ,...,L-i • det(B - D{Y) L _r l C) 



(5f 
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where 



B 



v v 

1 kk 1 kj 

yYjk Yjj j 



D 



^ Yki Y k2 ■ • • Y k L _i ^ 



Y 



and C 



3 L-l J 



Y\k Yij 
Yzk Y 2 j 



(59) 



^ Yl-i k Y L _i j ^ 

We see that the matrix G = D(Y~ 1 )l-iC have its components as 

L-l L-l 

Gn — Yk n T n ,n'Y n 'k 

n=l n'=l 
L-l L-l 
G±2 = ^ ^ YkjXn,n'Y n 'j 
n=l n'=l 
L-l L-l 

G2I = X! X! Yj n T n ,n'Y n ik 
n=l n'=l 
L-l L-l 

Y n u 

n=l n'=l 

Note that T = Y _1 is the inverse of the matrix 



Y = 



One thing to remember is that 



Y 
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■ Y 1L _! 



Yl-i 1 ■ ■ ■ Y L _i L _ 



V 



(60) 



(61) 



r„,„' — (— i) n+n if n / jn / Ai )2 ,...,l-i 



(62) 



where H n i n is the minor corresponding to matrix element at row n! and column n of the 
matrix (Y) i _ 1 . 

The most important observation here is that 

L-l L-l 



r n,n'Y n 'j - (~l) n+n Y nlj H nltn /A h2 ,...,L-l 



(63) 



n'=l n'=l 

Note that the RHS of the above eq is nothing but expanding the determinant of the 
following matrix along the nth column 
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Y 2 i 
Yl-x 



Y\ n -i 
Y2 n-1 



Y 



Y 1 



n+l 



Y 2j Y 



2 n+l 



Y2L-1 



y - 1 L-i 1 

divided by Ai i2 ,...,l-i- Moreover, 



Yl-1 n-l Yl-i j Yl_i 



n+l 



L-l 



(64) 



det 



Y n 
Y 21 



Yin-i Y\j 
^2 n-l ^2 j 



^1 n+l 
Y2 n+l 



-1 n-l Yl-h Y L -\ 



^2 L-l 



Xl-i 



("lJ^-XnO') (65) 



by the definition of A L , n (j). This is due to the fact that we need to switch columns 
(L — l)—n times in order to move the rightmost column L — 1 to be at column n without 
changing the order of the rest. And also because (— l) 2 ™ = 1 always. 
We therefore have 

L-l 



E r n,n'Y n/j = (-l) L+B - 1 A L , B (j)/Al A ..,L-l 

£>SJV = (-i^^lO'VAi.v.l-i 



n'=l 
L-l 



(66) 



n=l 



Note that the second equality came from transposing the first equality and then set the 
dummy variables n! — > n and call n n'. Since the determinant is invariant under matrix 
transposition, the RHS is obtained by just swapping n and n' and also transposing the 
minor. Note also that A n i^(j) is the minor of the matrix element on row n' column L of 
the matrix Y^. 

We therefore can rewrite the matrix element G in a much simpler fashion 

Gn = Etl(-^ L+n ^Y k nA L , n (k)/A lt 2,..., L - 1 = J2(-l) L+n ' 1 Y nk A ntL (k)/A lt 2,..., L - 1 

n=l 

G 12 = EnZl(-l) L+n - 1 Y kn A L , n (j)/A lt 2,.., L - 1 = J2(-l) L+n - 1 Y nj A n , L (k)/A 1 ,2,..., L - 1 

n=l 

G21 = EnZl(-l) L+n - 1 Y j nA L , n (k)/A lt2 ,..,L-l^ ^{-if^Y^A^j) / A^L-l 



n=l 
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L-l 



G 2 2 = EnZl(-l) L+n - 1 Y j nA L , n (j)/A lt2r .^ l = £ (-l) i+ "-%A,zO')/A 1)2 ,.,z-l (67) 

?1=1 

We therefore may write A 1j2 ,...,l-i ■ ^i,2,-,L-i,k,j as 
Ai j2 ,...,l-i ■ A lj2 ,... )Z 1./., = A?, 2 ,..,l-i ■ det(S - G) (68; 

^ ■ A.,..../. . + ^(-^^^^(j) 



L-l 



rc=l 
L-l 



= Y kk ■ Ai i2 ,...,l-i + £ (-l) L+n n n i L , n (A;) 
n=i 

L-l 

- r kj ■ a,.,.....,. , + ^(-i) L+ ™n n i Ljn (j) 
n=i 

After some algebra and using eqs(f49"D and fl54]), we can write down the expression 
explicitly 



Y jk ■ A 1)2i ... )Z _ 1 + ^(-l) L+ ^„i Lin (fc) 



n=l 



1 A|. 2 ..../ | .A • A 



1,2,---,L-1 



l,2,-,L-l,(fc+j> 



2,---,L-l,fc 



- Ai 



2,-,L-l,j 



—4 Ai )2j . ■ Ai j 2,...,i,-i,fej 

"L-l 



"(^'fc Ykj) ■ ^l,2,---,L-l 



2 



J2(-l) L+n (Y kn A L<n (j) - Y jn A L>n (k) 



Ln=l 



+2Y jk ■ A 1)2 ,.,^ 



L-l 



£(-i) L+n (n n i L , n (i) - y in i L , n (A;) 



,n=i 



-2Y* 



L-l 



n=l 



(Y k j — Yj k ) ■ A 1>2l . 



L-l 



£(-l) L+ " (Y kn A L>n (j) - Y jn A L<n (k) 



Ln=l 



= - [clet (Y L _i(j Lc , k Lr )) - det (Y L ^(k Lc , j Lr ))} 2 
where the matrices Y L _i(j Lc , k Lr ) and Y L _i(k LcJ j Lr ) look like 



(69) 







O0l-i 






Y L -ij 


Y kl Y k2 ■■■ 


Yk 3 



\ ( 

Y L -1 (jL c ,^L r ) ~- 







Y\ k 




OOl-i 








Yl-i k 




Y j2 ■■■ 


Y 3 k- 



(70) 

Note that if the matrix elements of Y is symmetric, i.e. Y ]k = Y k j, the RHS of eq. (|69|) is 
identically zero. This is because the inverse of a symmetric matrix will also be symmetric. 
Therefore 
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L-l 

^ ] ( 1) ^fcn^L,ri(j) ^ ] Y kn V nn iY n /j ^ ] Y-nj^ n / n Yj n i ^ ^ ^jn'^n'.n^nk 

n=l n,n' n,n' n,n' 

= ^{-lf^'^Y^A^ik) = I ^{—l) L+n '~ 1 Y jn A Ljn {k) (71) 



n'=l 



n=l 



We now proceed to prove lemma 2. Using the decomosition (|48|), and eq. (|53"D and its 
similar forms, we may write the LHS of lemma 2 as 

L-l 



n=l 

L-l 

(y« + ■ Al,2,..,L-l + El- 1 )^" + ^L, 

n=l 

L-l 

(^ fe + Y kj ) ■ A. 2 .. ./. . + E(" 1 ) i+ " (^L,n(j) + ^nAt,,^) 

n=l 
L-l 

(fy + Ky) • A. 2 .. ./. . + E(-!) L+n fcn^,nO') + ^L, 



n=l 



(72) 



Using eq.([58l), we see that the corresponding G, similar to (|67D , of Ax^.^L-i.^fc+i) has 
the form 



L-l 



Gil = E(- 1 ) i+n_ly in^.n(i)/A 1 , 2 ,.,L- 1 
n=l 

C12 = E(-l) Z+n-1 ^[^L,n(A;) + iL,n(0]/Al A ...,r-l 

n=l 

G 2 1 = iZi-^'^knKnU) +^L,nO')]/A lj2 ,., i _ 1 
n=l 

G 22 = E(-1) L+ " _1 (n« + Ik) [A L ,n(fc) + ^L,n(01- 



(73) 



n=l 



Using similar expressions, we can write the RHS of lemma 2 as 

L-l 



L-l 



Yjj ■ A 1)2) ...,L_i + E(-l) i+n ^X,n(j) 
n=l 

(n* + ^ifc + *H + *«) • Al, 2 ,..,L-l + E ( Y kn + Yin) (A L ,n{ k ) + A L,n{ 1 ) 

n=l 

L-l 

{Y jk + Y 3l ) ■ Ai j2 ,...,i-i + El" 1 )^"^ (^,»(*0 + A L , n 

n=l 
L-l 

(T fci + Y^) • A 1)2 ,... )X _ 1 + E(-!) L+n ( Y knA L ,n{j) + YlnA L>n {j) 



n=l 
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L-l 



+ 



Y j3 • Ai )2 ,...,t_i + £(-l) L+n Y^L,„(j) 

n=l 

^ ' A 1)2 ,..,L-1 + E(-l) L+n ^L,n(A:) 
n=l 

^ • A,,...., , + X](-l) L+ "F, n iL,„(j) 

n=l 

^•A li2 ,.., L _ 1 + i:(-l) L+ri ^niL,„(/) 



n=l 

L-l 



• Ai j2 ,...,l-i + J2(-l) L+n Y kn A Ltn (k) 

n=l 

Yv ■ a,. 2 ...., . + x:(-i) L+ "n n i Liri (j) 

n=l 

*ii • A 1)V ,l-i + J2(-l) L+n Y ln A L , n (l) 

n=l 

Y l3 ■ A 1)V ,L-1 + X:(-l) L+n ^niL,n(j) 

71=1 



^•Al,V,L-l+E(-l) L+ "^,n(j) 

71=1 

(Y« + Y^) • Ai i2 ,...,L-l + E(-l) L+n (nn^L,n(0 + ^A.n 

71=1 

• A 1)2 ,..,L-1 + L ^(-l) L+n Y jn A Ltn (l)] \Y kj ■ A 1)2 ,..,L-1 + E(-l) L+n nniL,n(j) 
n=l J L n=l 

Y jfe • A 1i2 ,..,l-i + j:(-l) L+n Y jn A L , n (k)] \r l3 ■ A 1i2 ,..,l-i + J2(-l) L+n Y ln A L Aj) 



n=l 



L-l 



n=l 



(74) 



If we subtract the LHS of lemma 2 by the RHS of lemma 2, we get 



LHS\ 

lemma 2 

-RHS\ 

lemma 2 

1 r 

= -- Y jk - Y kj + J2(-l) L+n (Y jn A L , n (k) - Y kn A L:T 



71=1 



L-l 



n=l 



= -- [det (Y L ^(k Lc , 3Lr )) - det (Yr-xO'Le, ^lJ)] 
• [det (Yi-xCZ^, j L J) - det (Y^^, U)] 



(75) 



Again, if the matrix Y is symmetric, the difference between the LHS and RHS of lemma 
2 vanishes. This finish the proof of lemma 2. 

Finally, for the L — 1 case (where A 1)2i -,l-i = 1 and A 1j2j ...,l-ij = ^j), we may 
verify lemmas 1 and 2 by direct substitutions with the abbreviations A 1;2i ...,l-i = A and 



Ai, 2 ,., 



L-1,3 



= Aqj = A 3 when L — 1. 
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